Dynamic Computation Offloading with Deep Reinforcement Learning in Edge Network

نویسندگان

چکیده

With the booming proliferation of user requests in Internet Things (IoT) network, Edge Computing (EC) is emerging as a promising paradigm for provision flexible and reliable services. Considering resource constraints IoT devices, some delay-aware requests, heavy-workload device may not respond on time. EC has sparked popular wave offloading to edge servers at network. The orchestration user-requested schemes creates remarkable challenge regarding delay energy consumption devices networks. To solve this challenge, we propose dynamic computation strategy consisting following: (i) concept intermediate nodes, which can minimize current tasks handled by dynamically combining task-offloading service migration strategies; (ii) based workload node selection problem modeled multi-dimensional Markov Decision Process (MDP) space, deep reinforcement learning algorithm implemented reduce large MDP space make fast decision. Experimental results show that superior existing baseline methods delays devices.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Mobile Edge Computation Offloading Using Game Theory and Reinforcement Learning

Due to the ever-increasing popularity of resourcehungry and delay-constrained mobile applications, the computation and storage capabilities of remote cloud has partially migrated towards the mobile edge, giving rise to the concept known as Mobile Edge Computing (MEC). While MEC servers enjoy the close proximity to the end-users to provide services at reduced latency and lower energy costs, they...

متن کامل

Deep Learning with Dynamic Computation Graphs

Neural networks that compute over graph structures are a natural fit for problems in a variety of domains, including natural language (parse trees) and cheminformatics (molecular graphs). However, since the computation graph has a different shape and size for every input, such networks do not directly support batched training or inference. They are also difficult to implement in popular deep le...

متن کامل

Dynamic Network Formation with Reinforcement Learning

I examine a dynamic model of network formation in which individuals use reinforcement learning to choose their actions. Typically, economic models of network formation assume the entire network structure to be known to all individuals involved. The introduction of reinforcement learning allows us to relax this assumption. Q-learning is a reinforcement learning algorithm from the artificial inte...

متن کامل

Deep Reinforcement Learning for Dynamic Multichannel Access

We consider the problem of dynamic multichannel access in a Wireless Sensor Network (WSN) containing N correlated channels, where the states of these channels follow a joint Markov model. A user at each time slot selects a channel to transmit a packet and receives a reward based on the success or failure of the transmission, which is dictated by the state of the selected channel. The objective ...

متن کامل

Performance Optimization in Mobile-Edge Computing via Deep Reinforcement Learning

To improve the quality of computation experience for mobile devices, mobile-edge computing (MEC) is emerging as a promising paradigm by providing computing capabilities within radio access networks in close proximity. Nevertheless, the design of computation offloading policies for a MEC system remains challenging. Specifically, whether to execute an arriving computation task at local mobile dev...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Applied sciences

سال: 2023

ISSN: ['2076-3417']

DOI: https://doi.org/10.3390/app13032010